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Abstract: I. Introduction 



Abstract— Tracking a ground based target 
autonomously from an Unmanned Aircraft Systems 
(UAS) is a critical task for remote sensing or any 
Intelligence, Surveillance, and Reconnaissance (ISR) 
mission that requires precision pointing, and effective 
real-time data transmission/recording to the ground 
station. To achieve this, the authors introduce a novel 
non-linear closed form analytical algorithm derived 
based on coordinate transformation and vector 
algebra principles that was implemented onboard a 
small UAS. The Unmanned Aircraft Systems 
Engineering Laboratory (UASE) at University of North 
Dakota (UND), Grand Forks, ND developed a small 
UAV payload "SUNDOG" to demonstrate the 
autonomous tracking ability of the derived algorithm 
and its implementations. The major advantage of the 
algorithm is that, it allows the user to specify and 
maintains the camera/target orientation irrespective of 
the aircraft position and rotation, which helps the 
ground personnel to easily interpret the data 
effectively while tracking the target location in real- 
time. The equations provide an elegant closed form 
solution to a non-linear problem that can be easily and 
efficiently programmed. The algorithm was verified 
through several experimentations and demonstrated 
successfully in an UAS test flight. Actual flight data 
illustrating the effectiveness of the surveillance 
algorithm is presented. 

Keywords:Autonomous Tracking Algorithm, Precision 
Pointing, Multi-Axis Gimbal Tracking, Mini-UAV Payload. 



The objective of developing an autonomous tracking 
system is to allow small fixed wing UAS platforms to both 
station-keep on targets of interest and estimate accurate 
position information for those targets using onboard 
assets. Specific targets of interest vary from a stationary 
point on the ground (applications such as fire-fighting, 
surveillance, and atmospheric research) to cooperative 
and non-cooperative aircraft in the national airspace 
system for airborne sense and avoid ([1]-[2]). This concept 
is illustrated in Fig. 1. 

An autonomous tracking algorithm for a three-axis 
gimbal system using Global Positioning System (GPS) 
and Inertial Measurement Unit (IMU) information is derived 
using coordinate transformation and vector algebra 
principles. The final outputs of the algorithm are the three 
rotational angles required to point/track at a known 
stationary/moving target with a prescribed orientation. 
Irrespective of the aircraft position and its rotation, the 
derived algorithm tracks any known stationary target on 
the ground maintaining the user defined orientation. A 
custom developed C++ programming in a Linux platform 
was implemented in the payload to provide a 
communication link with all the sensors such as the GPS, 
IMU, motion controllers, autopilot, etc., that sends, 
retrieves, and process information to track the target. It 
also establishes a wireless communication from the 
ground station to the aircraft for effective ground control 
operation. Several experiments have been carried out to 
verify the tracking ability and the results are presented. 
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Fig. 1. Small UAS Autonomous Tracking System Concept 

A small UAS imaging payload has been designed 
and constructed by the Unmanned Aircraft Systems 
Engineering (UASE) team at the University of North 
Dakota (UND) that allows for full 3- axis rotation of electro- 
optical (EO) and uncooled thermal infrared (IR) cameras 
([3]-[5]). The first successful flight of this payload using the 
autonomous target tracking algorithm took place on 
October 18, 2008, in military restricted airspace over 
Camp Grafton Training Center, an Army National Guard 
Maneuver Training center near Devil's Lake, North 
Dakota. The payload was flown using the UND-Super 
Hauler UAV. Fig. 2 shows the electro-optical images 
captured using the autonomous target tracking algorithm 
during the actual flight. 




Fig. 2. Electro-Optical images captured while using 
autonomous target tracking algorithm 

Fig. 3 shows a CAD model and physical 
implementation of the three-axis gimbal system design, 
while Fig. 4 is a CAD model and physical implementation 
of an autonomous tracking payload known as the 
SUNDOG - Surveillance by University of North Dakota 
Observational Gimbal. 
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Fig. 3. Three-Axis Gimbal System CAD model (Left) and 
Physical implementation (Right) 




Fig. 4. CAD model (Left) and Physical Implementation 
(Right) of an Autonomous Tracking Payload "SUNDOG". 

The SUNDOG payload has the capability to track 
any known stationary target location autonomously and 
also manually point the camera towards the target location 
using a joystick. For precision pointing, a non-linear closed 
form analytical algorithm was developed to determine the 
exact rotation angles for a three-axis gimbal system to 
point a digital imaging sensor at any known target with a 
prescribed orientation. For autonomous tracking, the 
calculated rotation angles must be provided to the gimbal 
system so that it can accurately locate the defined target 
and track it accordingly as the aircraft moves. The 
algorithm derived in this paper was successfully 
implemented and tested in the SUNDOG payload. Since 
the algorithm uses simple algebraic closed form 
expressions to calculate the pointing angles of the gimbal, 
it requires less computational time to track the target when 
compared to many other algorithms making it more easily 
implemented in a small UAS with limited resources ([6]- 
[10]). The algorithm also maintains the camera orientation 
to north (user-defined) in the inertial coordinate system. 
This allows ground personnel to compare the real time 
video directly to the maps without any orientation 
misalignment making the data much more easily 
understandable. The limitation of the tracking algorithm 
mentioned ([6]-[10]) compared to the algorithm presented 
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defined with the x-axis being the tilt axis of the gimbal and 

initially aligned with the x-axis of the aircraft system. The 
y-axis of the gimbal is the pan axis of the gimbal. The z- 
axis of the camera is also defined as the line-of-sight axis, 
which is required to help solve for the pointing and 
orientation parameters. 



in this paper are, they do not maintain the camera 
orientation in the specified direction, there are 
discontinuities in the gimbal rotation, they are expensive, 
and are position and time dependent. 

The SUNDOG payload has the capability for a 
ground-based payload operator to manually control the 
pointing of the cameras with a joystick based upon real 
time video data received from the EO camera. For this, an 
algorithm was developed to determine the target location 
based on the position, attitude information of the aircraft, 
and gimbal pointing angles. This paper focuses only on 
stationary targets, but the algorithm has the ability to be 
extended to ground and air borne moving targets. 

II. Accurate gimbal pointing algorithms 



Kinematics Analysis of the System 

A kinematic analysis is done on a three-axis 
gimbal system to get the appropriate model of gimbal 
rotations in order to point at a certain location on the 
ground from an aerial platform. The mathematical model 
includes an inertial system that has coordinates fixed to 
the Earth, a coordinate system that is body-fixed to the 
aircraft and a third coordinate system that is fixed to the 
gimbal. The end results of the analysis are the rotation 
angles, about each gimbal axis, that will result in the 
gimbal pointing at the correct spot with a desired 
orientation. Correct orientation will allow an image to have 
the same orientation to the ground coordinates 
independent of the direction of flight. The scenario 
investigated is when the inertial coordinates of the target, 
the aircraft location and the orientation angles are known 
that are required for accurate pointing. 

As stated previously, this system includes three 
separate coordinate systems. These coordinates systems 
and their orientations are shown in Fig. 5. The orientation 
for the coordinate systems is arbitrary, but they do need to 
be defined. In this system the inertial coordinates were 
defined so that the x-axis is in the North direction, the y- 
axis is in the East direction and the z-axis is downward. 
The aircraft coordinates were defined with the x-axis being 
the same as the heading vector. The gimbal system is 



*c cl- 




ean (E) 





X% or Xc 



\'z or Yc 



Fig. 5. Orientation of Inertial Coordinate (Top), Aircraft 
Coordinate (Middle), Gimbal & Camera Coordinate 
(Bottom) 

The topic of coordinate transforms and the kinematics 
involved with flight have been well covered in the literature 
([11]-[20]). Often it is advantageous to define a system 
using multiple coordinate systems. The problem with 
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multiple coordinate systems is that vector operations 
cannot be done if the vectors are defined by different 
coordinate systems without transformations. Therefore, 
the components of a vector in one coordinate can be 
transformed into a vector in a different coordinate system. 
The first transform that is needed for this analysis is a 
transform between the inertial system and the aircraft 
fixed system. For this transform, a 3-2-1 (NASA Standard 
Aircraft) rotation is used [13]. In this situation, i|j is the 
heading angle, or yaw, and corresponds to a rotation 
about the z-axis of the aircraft, 9 is the pitch angle and is a 
rotation about the y-axis of the aircraft, and cp is the roll 
angle and is a rotation about the x-axis of the aircraft. 
These rotations are shown in Fig. 6. The order of rotation 
for this transform is 9, and then cp. The rotation matrix 
for this type of transform is well known and is shown in Eq. 
1 as R a . 










Y a 




► 




Fig. 6. Aircraft rotations of 9, and cp about the z, y, and x 
axis respectively. 



cy/c6 sy/c6 s6 

sy/c(j) + cy/s6s(j) cy/c0 + sy/s6s(j) c6s<j) 
sy/s(j) + cy/s6c(j) cy/s(j) + sy/s6c(j) c6c(j) 



(1) 



The next transform needed is from the aircraft fixed 
coordinates to the gimbal's camera fixed coordinates. This 
is done by first rotating about the z-axis by y, then rotating 
about the y-axis by |3, and then rotating about the x-axis 
by a. The rotation matrix for each of these individual 
rotations is shown in Eqs. 2 - 4 as R 1g , R 2g and R 3g , 
respectively. To find the total rotation matrix needed, the 
rotation matrices from the individual rotations are 
multiplied together as shown in Eq. 5 with the total rotation 
matrix shown in Eq. 6 as R g . 
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(5) 



(6) 



The order of rotation used for the R a matrix is 
arbitrary, but using a different order will result in a different 
rotation matrix. The order of rotation for the R g matrix will 
depend on the system setup and other systems may have 
different locations for the drive motors of each axis or they 
may move in a different order than what was used here. 
Whatever the order, these rotation matrices define the 
crucial relationship for transforming between coordinate 
systems. 

Three-Axis Gimbal Pointing Angles for Known 
Stationary Targets 

In many remote sensing applications, a gimbal 
system is required to point a sensor at a given target 
location. To do this, the proper rotation angles (a, |3, A) 
must be given to the gimbal system so it can accurately 
locate the target. In this section an algorithm is developed 
to find these rotation angles. The inputs into the system 
are aircraft location in inertial coordinates (GPS 
information), aircraft attitude (roll, pitch, and yaw), target 
location in inertial coordinates, and the offset distance of 
the gimbal from the GPS receiver on the aircraft. If the 
GPS offset is not included or is not known, there will be 
errors in the angles of rotation given to the gimbal. The 
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analysis for finding the rotation angles is done as if looking 
through the camera and maintaining the z axis of the 
gimbal system to point along the vector going from the 
gimbal location to the target location. 

The first step in finding the rotation angles is to 
define the known locations in the form of vectors. In Eqs. 
7-9, the P vector is the position of the aircraft in inertial 
coordinates, the T vector is the position of the target in 
inertial coordinates and the G 0 vector is the offset of the 
gimbal in aircraft fixed coordinates. 



P = 



X P 




X P 




X P 


<y p 


• , T = < 


y p 


> , G Q =< 


y p - 






{ z p\ 




{ z p\ 



(7-9) 



The location of the gimbal needs to be expressed 
in inertial coordinates to define the line of sight vector. To 
do this the inertial coordinates of the aircraft must first be 
transformed into the body-fixed coordinate system of the 
aircraft. This is done by multiplying the inertial coordinates 
by the rotation matrix, as shown in Eq. 10. 



{Pa)=[Ra]{P} 



(10) 



Once this is done, the gimbal offset, which is 
already in the body-fixed coordinates, can be subtracted 
from the aircraft coordinates to give the actual location of 
the gimbal in body-fixed coordinates (Eq. 11). 



{G a } = {Pa}-{G 0 } 



(11) 



The next step is to specify the required orientation 
of the camera image and this can be North, South, East or 
West. For example, to maintain the top of the camera 
image in North direction, the x unit vector in the gimbal 
system should always be aligned to the North direction, or 
in this case the inertial x-axis. Hence to maintain the 
camera orientation in Northern direction, Z axis rotation of 
the gimbal system (A) should be equal and opposite to Z 
axis rotation of the aircrafts (qj). Here, the gimbal location 
in aircraft coordinates needs to be transformed to the 
gimbal coordinate. This is done by multiplying the aircraft 
coordinate by the rotation matrix "R", as shown in Eq. 12. 



{G ag \=[R\{G a } 



(12) 



Where, R = 



cX sX 0 
— sX cX 0 
L 0 0 1 



and A = - qj 



Now the gimbal location needs to be transformed 
back into the inertial coordinates so that the vector 
between the gimbal and target can be defined. This is 
done by multiplying the gimbal location by the inverse of 
the systems rotation matrix, as shown in Eq. 13. 



{G} = ([R]M)- l -\G 



ag 



(13) 



The line of sight vector is then defined as the 
difference between the gimbal location and the target 
location, both in inertial coordinates, as shown in Eq. 14. 



{D}={T}-{G} = 



Ay 
Az 



(14) 



The line of sight vector then needs to be 
transformed into the body-fixed coordinates of the aircraft. 
This is done by using the aircraft rotation matrix, as shown 
in Eq. 15. 

r Ax a 

(15) 



{D a }=[R][R a ]{D} = \Ay a 

Az 



a 



The final rotation is to transform the pointing 
vector into the gimbal fixed coordinate system. The angles 
needed for this rotation are the angles that will be the 
pointing angles for the gimbal. Therefore they are 
unknown, but, by using specific constraints, the equations 
from the rotation will provide the pointing angles. The 
transformation is shown in Eq. 16. 



D g \ = 



R g\i D a}= 



(cyc{J)Ax a + (syca + cyspsa)Ay a + (sysa - cysPca)Az a 
(sycP)Ax; a + (cyca - syspsa)/ty a + (cysa + syspca)Az a 
(s/3)Ax a +{-cPsa)Ay a +{cPca)Az a 
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(16) 
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In this system, the z-axis of the camera falls along 
the line of sight vector and this fact is used to solve the 
equations for the unknown variables a, (3, and y. 
Therefore, when the line of sight vector is expressed in 
terms of the gimbal fixed coordinate system, it will not 
have any components in the x or y direction of the gimbal 
system. This provides the following two equations (Eqs. 
17-18). 



Axg = 0 ; Ay g- = 0 



g 



(17-18) 



Therefore, by applying Eqs. 17-18 in Eq. 16, it 
reduces to the following equations, as expressed in Eqs. 
19-20. 



a = -tan 



-1 



f 



a 



(23) 



Similarly solving Eq. 21 with respect to (3 gives Eq. 24 



P = - tan 



-1 



Ax 



a 



[saAy a -caAz a J 



(24) 



To maintain the camera orientation, the rotation 
about the Z axis of the gimbal system (A) should be equal 
and opposite to as shown in Eq. 25. 



X = -i// 



(25) 



(cycfl)Ax a + (syca + cysjBsa)Ay a 
+ (sysa - cysf5ca)Az a = 0 

(sycp)Ax a + (cyca - sysfisa)Ay a 
+ (cysa + sys/3ca)Az a = 0 



(19) 



(20) 



This results in two equations with three unknown 
variables. To solve Eqs. (19-20), the three unknown 
variables are reduced to two unknown variables by finding 
any one of the variables a, |3, or y. For this system, the 
variable y is found by defining a constraint. This constraint 
comes from the fact that the x axis of both the 
gimbal/camera fixed coordinate and the inertial coordinate 
have been chosen to be aligned (parallel) to each other. 
Since, the x axis of the gimbal coordinate is already 
aligned to the x axis (North direction) of the inertial 
coordinate, which is obtained by Eq. 12, the rotation about 
the z axis of the camera or y is equal to zero in the gimbal 
coordinate system. Applying this constraint in Eqs. 19-20, 
Eqs. 21-22 are found. 

(cj3)Ax a + (sj3sa)Ay a - (cysj3ca)Az a = 0 (21) 



(ca)Ay a + (sa)Az a = 0 



Solving Eq. 22 with respect to a gives Eq. 23 



(22) 



With all three of these rotation angles defined (a, 
(3, A), a controller can give precise commands to the 
gimbal system to accurately locate a target and orient the 
camera's image, so that the top is always in the northern 
direction. 

The algorithm derived here is a novel, nonlinear 
closed form analytical expression (Eqs. 23-25) which uses 
position and attitude information of the aircraft to calculate 
the exact rotation angles for a three-axis gimbal system to 
point a digital imaging sensor at a target. Since the 
algorithm uses simple algebraic expressions to determine 
the gimbal pointing angles, pointing the imaging sensors 
towards the target is computational efficient. The authors 
are not aware of any other published algorithms that result 
in closed form solutions with heading corrections for use 
onboard an UAS. 



ill. Implementation 



A. SUNDOG 



The Surveillance by University of North Dakota 
Observational Gimbal (SUNDOG) payload includes a 
three-axis precision pointing system for an EO camera 
and an uncooled thermal IR camera. This payload was 
developed to capture both the infrared and electro-optical 
video image of the ground which will be useful in 
agricultural and surveillance applications. Initially, a 
sensor operator on the ground was able to aim the two 
cameras in flight via a joystick control, useful for 
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applications in surveillance and target tracking. To 
eliminate the use of joystick and fully automate the target 
tracking, the novel nonlinear closed form algorithm 
presented was developed. This algorithm uses position 
and attitude information of the aircraft to calculate the 
pointing angles of the gimbal system. Most of the 
hardware and software utilized in the payload design is 
commercial-off-the-shelf or share-ware in nature. Fig. 7 
provides a diagram of the commercial-off-the-shelf 
(COTS) hardware utilized in the payload and ground 
control station design. 



Ground Station Payload 




Fig. 7. COTS hardware and software diagram for the 

SUNDOG payload. 

B. Software 



The camera pointing system demands a complex 
coordination of software to accurately position the 
cameras based on ground station commands. The ground 
station runs Windows XP and includes applications such 
as Flight Gear, Putty, and VLC. Flight Gear is an open- 
source flight simulation application that allows wireless 
commands to be sent to the payload. The payload utilized 
a Linux operating system called OpenSuse 10.2 and 
includes OpenSSH and VLC applications along with a 
custom-written C++ program. Putty and OpenSSH permits 
secure system commands to be sent from the ground 
station to the payload. VLC wirelessly streams the video 
from the two cameras on the payload, which can then be 
received by the ground station and shown for near real- 
time feedback. The custom C++ program performs several 
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tasks such as receiving the ground station's motor control 

commands and sending IMU and GPS data to the ground 
station. Wireless control of the payload motors from the 
ground station was achieved by using the PC/1 04+ stack. 
The motor control commands originate from a three-axis 
joystick connected to the ground station via a high-speed 
USB port. Flight Gear recognizes the joystick input and 
changes values within the program's property tree 
accordingly. Flight Gear's property tree contains a list of 
flight control variables that can be used to manipulate a 
remote aircraft or other system. There are other variables 
within the property tree that, when changed by incoming 
data, communicate to Flight Gear the navigation, 
orientation, and system status of the payload. In the case 
of motor control, the three-axis joystick inputs are 
interpreted and assigned to three of the Flight Gear flight 
control properties. While Flight Gear is running, it can 
constantly send these control property values to a 
designated IP address using the user datagram protocol 
(UDP) communication protocol. 

On the payload side, custom C++ program was 
developed to set up a host socket to receive commands 
from the ground station IP address. The payload receives 
the UDP packets, which contain the control properties 
from Flight Gear. The programming code finds the desired 
properties, performs calculations on the property values, 
and sends the corresponding velocity commands to the 
three motion controllers through an RS-232 serial port. 
These parameters are translated into motor motion at the 
desired velocity in revolutions per minute. The C++ code 
compiled on the payload PC/1 04+ SBC utilizes POSIX 
threads or pthreads. These pthreads allow the C++ code 
continuously execute several operations, including 
scanning for incoming UDP packets, making calculations 
on the Flight Gear properties, and sending velocity 
commands to the motion controllers. 

Last addition to the custom C++ program allows for 
position feedback from the motors. To achieve this, a 
method was added to the coding sequence, which sends 
a position query to each controller in the same manner 
that velocity commands are sent. The controller retrieves 
the position value from the incremental encoder and 
relays this value back to the PC/1 04+ SBC through the 
serial port as a string of ASCII characters. The C++ 
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IV. Experimentation 



program parses the incoming serial data and outputs the 
motor position. This ability to retrieve motor position is 
important in automated object tracking. 

The final feature added to the custom C++ program 
was implementing the autonomous tracking algorithm 
which uses the position and attitude information of the 
aircraft. This program receives the INS/GPS information 
from the Piccolo autopilot and calculates the gimbal 
rotation angles based on the procedure explained in 
Section II. After calculating the gimbal rotation in number 
of ticks, the program sends the appropriate commands to 
the motor controller to rotate the gimbal. The payloads 
transmit the INS/GPS and gimbal rotation values real-time 
to the ground station. The processing time to compute the 
rotational angles of the gimbal system is approximately 
the same as that of the input frequency of the system. For 
example, if the Piccolo sends the information to the 
program at a 20 Hz rate, then the processing rate of the 
program will be approximately 20 Hz. There is not a 
significant time delay in processing the algorithm because 
it computes the information within one millisecond. 

In order to find the processing time of the gimbal system 
to attain the desired position from its current position, an 
analysis was carried out by using a timer function which 
compute the exact time taken by the gimbal system to 
reach the desired position. The three rotational angles 
(Alpha, Beta, Gamma) of the gimbal system were given as 
5 degrees individually and the algorithm was run to 
determine the time taken to rotate the gimbal system. This 
experiment yielded an average of 0.01 seconds to 
manipulate and rotate the gimbal system accordingly. 
Based on the analysis, the gimbal system can operate at a 
maximum frequency of approximately 100 Hz. Since the 
algorithm does not require significant computational time 
to process and rotate the gimbal system, it was 
implemented and demonstrated successfully in real-time 
using the onboard SBC at a rate of 20 Hz. 



In order to verify the tracking ability and the accuracy of 
the three-axis gimbal system, several experimentations 
including a laboratory experiment, mobile ground vehicle 
test, and actual flight test were carried out. Initially, a 
laboratory experiment was conducted to verify the pointing 
algorithm with change in attitude information by fixing the 
aircraft and the target location. Then an experiment using 
a mobile vehicle test was carried out by fixing the target 
location and changing the position of the payload. As the 
payload moves along with the vehicle, the Piccolo updates 
its GPS and attitude information which are then used to 
calculate the pointing angles of the gimbal system. While 
the pointing algorithm points the camera to the target 
location, a real time EO and IR video are simultaneously 
streamed and saved to determine whether the camera is 
pointing at a target or not. Similarly, flight tests with the 
payload was carried out by fixing the target location at the 
ground and specify the target location to point the gimbal 
based on the GPS and attitude information of the aircraft. 

A. Actual Flight Test 

The flight test was carried out at the Camp 
Grafton Training Center (CGTC) with custom developed 
UAV called "Super Hauler," owned and operates by the 
UASE, to verify the SUNDOG payload with autonomous 
tracking algorithm. CGTC is a National Guard Maneuver 
Training Center operated by the North Dakota National 
Guard. CGTC is located 45 miles South of Devils Lake in 
northeast North Dakota. Based on UASE team 
requirement, the UAV "Super Hauler," shown in Fig. 8, 
was built by Bruce Tharpe Engineering. 




78 



www.ijitce.co.uk 



International Journal of Innovative 

Fig. 8. UND's UAV "SuperHauler" 

UAV "Super Hauler" is made of balsa wood and 
plywood with aluminum and carbon fiber elements. It has 
a wingspan of 3.7 meters, a wing area of 2.4 square 
meters, and 3 meters of length. The dry weight of the 
vehicle is 21.8 kilograms and has 13.6 kilograms of 
maximum payload carrying capacity. The main payload 
compartment has a volume of 0.054 cubic meters. 
Additionally, there is an open space in the rear part of the 
fuselage of about 0.035 cubic meters used for placement 
of avionics (including autopilot). The BTE Super Hauler is 
powered by a Desert Aircraft (DA) 100cc two stroke 
engine, whose specifications are shown in Table 1. 



TABLE I 

DA-100CC Specification 



Displacement 


6.10 ci (100 cc) 


Output 


9.8 hp 


Weight 


5.8 lbs (2.63 kilos) 


Bore 


1.6771 in (42.6 mm) 


Stroke Length 


1.3779 in (35 mm) 


RPM Range 


1,000 to 6,700 


Max. RPM 


8,500 


Fuel 

Consumption 


1 . 1 72 gallons/hour @ 6000 
RPM 



Before the actual flight test, a preflight meeting 
was conducted with the internal and external pilot in 
command to discuss and decide the target location, actual 
flight path and the altitude required during the testing. A 
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blue colored tarp of dimension 2 x 2 m was fixed on the 
ground and its GPS coordinate was used as the target 
location in the tracking algorithm. Fig. 9 shows the aircraft 
flight path obtained from the flight test in Google Earth. 
Apart from the preplanned flight path, different flight path 
patterns are carried out to test the target-locked and out of 
range region. The term "Target-Locked" refers to the 
aircraft position when the camera was pointed at the 
target and "Target-Out of Range" referred as the aircraft 
location when camera was not pointed to the target due to 
the angular limitation of the gimbal system. The NED 
coordinate information is shown in the Fig. 10 which 
illustrates that the aircraft was flown at a constant altitude 
during the autopilot stage. Fig. 11 shows the attitude 
information of the aircraft and Fig. 12 shows the rotation 
angles of a three-axis gimbal system in degrees. From 
Fig. 12, it can be noted that the gimbal rotational angles 
follows an identical pattern during the autopilot stage, as 
expected due to the repeated flight path. 




Fig. 9. Aircraft's flight path shown in Google Earth 
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Fig. 10. Aircraft's Position - Flight Test 
Fig. 10-1 2 shows that as the North value decreases, the Y- 
axis rotation of the gimbal system (beta) increases. This 
similar pattern was obtained during the MGV test. Fig. 13- 
15 shows the actual video snapshots obtained during the 
flight test with the EO camera. Since the orientation was 
specified to be in North direction, the algorithm maintains 



the camera orientation always in the North direction 
regardless of the aircraft position and rotation. This is 
seen in the images that the target remains in the center 
and the road maintains its orientation while the aircraft 
moves along its flight path. Note the changes in GPS 
location, IMU readings, and resulting gimbal rotations for 
the snapshots shown. 
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Fig. 1 1 . Aircraft's Attitude information - Flight Test 
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Fig. 12. Gimbal Rotation based on GPS & IMU 
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Fig. 13. EO video snapshot # 1 obtained from the flight test. 
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Fig. 14. EO video snapshot # 2 obtained from the flight test. 
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Fig. 15. EO video snapshot # 3 obtained from the flight test. 
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compared with the distance moved by the pointing 

algorithm to calculate the accuracy of the tracking 
algorithm. Fig. 16 shows the graphical form of target offset 
obtained in the flight test experimentation. 



Based on the data obtained, an error analysis was 
carried out to estimate the tracking accuracy. The actual 
distance between the aircraft and the target location are 
measured in terms of NED coordinates, and then 
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Fig. 16. Target Offset - Flight Test 



In Fig. 16, green circle represents the maximum 
field of view of the camera (500 m) at an altitude of 300 m 
and the blue circle represents the error obtained from the 
flight test including the IMU error (±2 deg), GPS error (3-6 
m) and gimbal manual setup error (±2 deg). The results 
obtained from the actual flight test are more significant 
and promising because the target offsets are well within 
the maximum error possible range, the target was always 
in the field of view of the camera when the target was 
locked and the camera orientation was always aligned in 
the specified direction (North). The accuracy of the 
algorithm obtained from the flight test is 95 % with an 
average of 22 meters and a standard deviation of 8 
meters. Another error analysis was carried out to find out 
the angular error occurred due to the target offset. The 
angular error is calculated based on target offset obtained 
and the normalize distance between the aircraft and the 
target location. Based on the angular error analysis 
calculation, an average error of 3.45 degrees and -1.77 
degrees are obtained in the East and North direction, 
respectively. The results obtained from the angular error 
analysis shows a significant and better understanding of 



the data because the angular error obtained in terms of 
North and East direction are well within the maximum 
possible error ±6 degrees, which includes the IMU error 
(±2 degrees), gimbal manual setup error (±2 degrees), 
and GPS error (3 - 6 meters). 

Fig. 17-18 shows the aircraft location when the 
target was locked and out of range, respectively. In Fig. 
17, the green pattern represents that the target was 
locked and the red pattern represents the target was out 
of range due to the angular restriction in the gimbal 
system. The gimbal rotation angles are restricted (Alpha = 
± 25 deg& Beta = ± 75 deg) due to the physical structure 
and wiring connection of the gimbal. Since the roll 
limitation of the gimbal system (± 25 deg), the target 
tracking was restricted to a minimum distance in the East- 
West direction. The distance varies depending upon the 
altitude of the aircraft. This is the current condition, but by 
increasing the roll limit to 80 degrees (future), the aircraft 
can have broader aerial field of view to track the target, as 
shown in Fig. 18. 
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Based on the error analysis and the EO video 

images obtained from the flight test, we can conclude that 
the target specified was always centered in the field of 
view of the camera when the target was locked. The 
results obtained from the flight test are very significant and 
promising because the target was well within the 
maximum error possible range and the camera was 
always oriented in the specified direction (North). 

V. Conclusion 
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Fig. 17. Target Locked and Out of Range when Alpha = ± 

25 deg& Beta = ± 75 deg 
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Fig. 18. Target Locked and Out of Range when Alpha = ± 

80 deg & Beta = ± 75 deg 



A novel non-linear, closed form analytical 
expression for the three-axis gimbal system was derived 
to calculate the exact pointing angles with specified 
orientation based on GPS and IMU information of the 
aircraft. The orientation of the camera can be specified in 
any direction (North, East, West, and South). The 
autonomous target tracking (ATT) algorithm was 
successfully implementation in a payload called 
"SUNDOG"- Surveillance by University of North Dakota 
Observational Gimbal installed in a small UAS. ATT was 
tested through several experimentation including a 
laboratory, a MGV test, and actual flight tests. An average 
accuracy of 95 %, or 5 % inaccuracy, with a standard 
deviation of 8 meters and an average of 22 meters was 
obtained in the flight experiments. The results obtained 
from the experiments are very significant and promising 
since the target was always in the field of view of the 
camera and within the maximum error possible range 
including the IMU, GPS and gimbal manual setup error. 
Also, the target was always maintained in the specified 
orientation (North). Without any human interface, the ATT 
algorithm was demonstrated successfully in real-time 
using a custom developed C++ program in an UAS flight. 
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